On-line Sequential Extreme Learning Machine Based on Recursive Partial Least Squares

نویسندگان

  • Tiago Matias
  • Francisco Souza
  • Rui Araújo
  • Nuno Gonçalves
  • João P. Barreto
چکیده

This paper proposes the online sequential extreme learning machine algorithm based on the recursive partial leastsquares method (OS-ELM-RPLS). It is an improvement to the online sequential extreme learning machine based on recursive least-squares (OS-ELM-RLS) introduced in [1]. Like in the batch extreme learning machine (ELM), in OSELM-RLS the input weights of a single-hidden layer feedforward neural network (SLFN) are randomly generated, however the output weights are obtained by a recursive least-squares (RLS) solution. However, due to multicollinearities in the columns of the hidden-layer output matrix caused by presence of redundant input variables or by the large number of hidden-layer neurons, the problem of estimation the output weights can become ill-conditioned. In order to circumvent or mitigate such ill-conditioning problem, it is proposed to replace the RLS method by the recursive partial least-squares (RPLS) method. OS-ELM-RPLS was applied and compared with three other methods over three real-world data sets. In all the experiments, the proposed method always exhibits the best prediction performance.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

On-Line Sequential Extreme Learning Machine

The primitive Extreme Learning Machine (ELM) [1, 2, 3] with additive neurons and RBF kernels was implemented in batch mode. In this paper, its sequential modification based on recursive least-squares (RLS) algorithm, which referred as Online Sequential Extreme Learning Machine (OS-ELM), is introduced. Based on OS-ELM, Online Sequential Fuzzy Extreme Learning Machine (Fuzzy-ELM) is also introduc...

متن کامل

Recursive least mean p-power Extreme Learning Machine

As real industrial processes have measurement samples with noises of different statistical characteristics and obtain the sample one by one usually, on-line sequential learning algorithms which can achieve better learning performance for systems with noises of various statistics are necessary. This paper proposes a new online Extreme Learning Machine (ELM, of Huang et al.) algorithm, namely rec...

متن کامل

An Internal Model Controller for Three-Phase APF Based on LS-Extreme Learning Machine

Aiming at the problem that the three-phase APF’s dynamic model is a multi-variable, nonlinear and strong coupling system, an internal model controller for three-phase APF based on LS-Extreme Learning Machine is studied in this paper. As a novel single hidden layer feed-forward neural networks, extreme learning machine (ELM) has several advantages: simple net structural, fast learning speed, goo...

متن کامل

Recurrent least square learning for quasi-parallel principal component analysis

The recurrent least squares (RLS) learning approach is proposed for controlling the learning rate in parallel principal subspace analysis (PSA) and in a wide class of principal component analysis (PCA) associated algorithms with a quasi{parallel extraction ability. The purpose is to provide a useful tool for applications where the learning process has to be repeated in an on{line self{adaptive ...

متن کامل

Improving the Estimation of Travel Demand for Traffic Simulation: Part II

This report examined several methods for estimating Origin-Destination (OD) matrices for freeways, using loop detector data. Least squares based methods were compared in terms of both off-line and on-line estimation. Simulated data and observed data were used for evaluating the static and recursive estimators. For off-line estimation, four fully constrained least squares methods were compared. ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2015